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Abstract 

Ising spin-glass systems with long-range interactions ( ~ r~°') 
are considered. A numerical study of the critical behaviour is pre- 
sented in the non-mean-field region together with an analysis of the 
probability distribution of the overlaps and of the ultrametric struc- 
ture of the space of the equilibrium configurations in the frozen phase. 
Also in presence of diverging thermodynamical fluctuations at the crit- 
ical point the behaviour of the model is shown to be of the Replica 
Simmetry Breaking type and there are hints of a non-trivial ultra- 
metric structure. The parallel tempering algorithm has been used to 
simulate the dynamical approach to equilibrium of such systems. 

The Long-Range Spin-Glass Model 

The greatest incentive to study spin-glasses with long-range interactions is 
that they are conceptually half-way between the Sherrington-Kirkpatrick 
(SK) model, exactly solvable in mean-field theory, and the more realistic 
short-range models, with nearest-neighbour interactions. Long-range spin- 
glass models are particularly interesting because already in one dimension 
they show a phase transition between the paramagnetic and the spin-glass 
phase. So it is possible to study this transition, also out of the range of 
validity of mean-field approximation, in a relatively easy way in comparison 
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with theories with short-range interactions below upper critical dimension. 
Furthermore these one-dimensional models serve as a clarifying, qualitative, 
analogy for short-range models in higher dimensions. 
The Hamiltonian of these kind of systems is: 

Ti. = -J^JikSiSk, (1) 

i<k 

where i = 1,N, the size of the system, the Si are Ising spin variables and 
the Jik are quenched, Gaussian random variables. They have mean zero and 
variance: 

\i — k\ 



where C{a) is just a normalizing factor, such that J^ikJfk = periodic 
boundary conditions have been used (i.e. i — k = N — i + k for i ~ k > y). 

Already in one dimension the long-range systems show different behaviours 
varying the value of a. First of all, to allow thermodynamical convergence 
we must have a > 1/2 |^. For l/2<cr<2/3a continuous phase transi- 
tion is present, describable in the mean-field theory approximation; the limit 
amf = 2/3 is found in the renormalization approach from the dimension of 
the coupling constant. Using the replica trick, in fact, we are able to get the 
Landau-Ginzburg effective Hamiltonian corresponding to the Hamiltonian 
([1|). In d dimensions it is: 



where a,b and c are the replica's indices and the dimension of the coupling 
constant is, then, 

dg = 3a-2 (4) 

for d = 1. So (7 is irrelevant for cr < 2/3 (or marginal for a = 2/3). When 
2/3 < 0" < 1 the phase transition is supposed to still be present but we are 
in an infrared divergent regime causing mean-field theory to lose consistency 
at the critical temperature: it is then necessary to renormalize in order to 
find the correct critical indices. In the case a = 1 is not yet clear what kind 
of transition there is. Kotliar et al. 0] supposed a behaviour similar to the 
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analogous case of the long-range ordered magnetic systems with interactions 
decaying like in which Anderson et al. and then, in a version for 

general discrete models, Cardy , had found a Kosterlitz-Thouless-like phase 
transition |Q. Anyway nothing rigorous has been proved until now for this 
value of a. Finally, for ex > 1, there is only one Gibbs thermodynamical state 
at all temperature, as rigorously proved in 0. 

There is, actually, an analogy with the critical behaviour of short-range 
systems. Starting from the lowest allowed value of the exponent driving the 
intensity of the bonds and increasing it, we can observe behaviours qualita- 
tively similar to those of short-range models in different dimensions: from 
mean-field {d > 6) to infrared divergent regime and up to the case of absence 
of phase transition. 

Our contribution has been to determine the critical temperatures and 
the critical indices in the regime of diverging fluctuations at the critical 
point for different long-range systems (different values of a). Besides we 
have examined the features of the space of the equilibrium configurations for 
finite-volume systems, getting various hints about the existence of a replica 
simmetry breaking (RSB) scenery also in the region of infrared divergences. 
Furthermore, through the evolution in time of three independent replicas, 
we have got elements in favor of the existence of an ultrametric structure of 
the equilibrium states; therefore sustaining the idea that this kind of phase 
space belongs intrinsically to spin-glasses, and that it does not depend on 
mean-field theory formulation, in which framework it was initially derived. 

We have done numerical simulations of these systems with different power- 
law behaviours, i.e. changing the value of the exponent a. We took a = 0.69 
and cr = 0.75, both beyond cTmf- They are the same values chosen by Bhatt 
and Young in so as to compare the common results. Every system has 
been simulated in different sizes so to use the finite size scaling techniques: 
five sizes between 32 and 512 spin have been investigated for every value of a. 
In this way we have got the critical indices and we have compared their values 
with the theoretical values obtained from one-loop expansion in e = a — amf 
0. Moreover in every numerical run we have looked at the parallel evolution 
of three independent replicas (observed in the same bond configuration). In 
this way it has been possible to study observables built from three different 
overlaps, that are useful to probe the ultrametric structure of the equilibrium 
configurations of a spin-glass, also out of the mean-field range of validity. 

To simulate the dynamical approach to equilibrium we have used the 
parallel tempering algorithm 0. The evolution of every system has been 
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simulated in a number of different random quenched samples varying between 
200 (for N = 512) and 600 {N = 32), for 65536 Monte Carlo steps each. The 
thermalization times, in MC steps, were all at least 30 times smaller than this 
value. In order to find the thermalization we have, first af all, checked that 
the time that each configuration simulated in the parallel tempering spends 
in every heat bath is independent of the temperature of the bath. Also, 
we checked that the probability of exchanging two configurations between 
two different baths is almost the same for every couple of temperatures and 
it is always greater than 0.3 for the set of temperatures chosen to perform 
the parallel tempering simulation. Finally, the most important check on 
thermalization has been to look at the absence of drifting of the observables 
(the kurtosis of the overlap distribution and the spin glass susceptibility) on 
the logarithmic scale of time, after they reached their plateau values. 



Critical Behaviour 

To determine the critical temperature we have used the finite size scaling 
(FSS) property of the observable: 



(5) 

called Binder parameter. Here <> stands for the mean over the thermody- 
namical ensemble, while the overline represents the mean over the random 
distribution of the bonds. The overlap q is defined, for our numerical goal, 
as: 

<1-T.^^ (6) 

i 

where the upper index is the real replica's one. 

The finite size scaling form of the Binder parameter is: 



9 = 9 



{n^{T-%)) (7) 



where N is the size of the system. Since at T = Tc, for every size, is g = ^(0), 
the critical temperature can be deduced from different sizes g{T) intersec- 
tions. To compute it, we have used the scaling behaviour of the "critical" 
temperature for a finite size system: 

T^{N) -T^ N-^, (8) 
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Figure 1: Binder parameter g vs. temperature for different sizes for the 
model with a = 0.69 (left) and the model with a = 0.75 (right). In the first 
case the 32 to 512 sizes are plotted, in the second one only the 64, 128, 256 
and 512 are represented. 



where the Tc{N) is the abscissa of the intersection point between the g(T) 
for the size N/2 and the g{T) for the size N and ^ = 1/z/ ||^. Thus, fitting 
the curves of T^^N) for both long-range systems (a = 0.69 and a = 0.75) 
with a power-law function, we have been able to extrapolate the following 
values for the critical temperature in the thermodynamical limit (T^°° in (|^)). 
We have got (see figure |I|): 

Tc = 0.75 ±0.1 ,for(T = 0.69, (9) 
Te = 0.63 ±0.08 , for a = 0.75. (10) 

The first result is consistent with the two estimates of for a = 0.69: 
Tc ~ 0.73 and Tc ~ 0.78. However they couldn't localize the transition 
temperature for a = 0.75. Instead, we have found that there is clearly 
a second order phase transition also at cr = 0.75, well besides the region 
of validity of the mean-field theory. In analogy with short-range models, we 
observe that the behaviour of the Binder parameter is qualitatively similar to 
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that of four- dimensional short-range spin-glasses, far below the upper critical 
dimension and over the lower critical dimension (LCD) [jlO| |12[ . 



From the g^s FSS properties we have determined also the critical index u 
We haven't used the value of the parameter 9 = - computed from the 



fit @ because of its very large uncertainty. Instead to estimate it we have 
first done the derivative of g with respect to T at a given value g^. In fact, 
from (1^ follows: 

dg 



dT 



^AL-. (11) 

To:g{To)=go 

We have computed the values of the derivative for the values of g cor- 
responding to the confidence interval of the critical temperature. In this 
interval of (?- values we have fitted the g{T) curves, in every size, with poly- 
nomials of various order (by the fact of second or third order), each time 
looking for the polynomial of the lowest possible order giving a fit satisfying 
the test. 



for 

To:g{To)=go 



For every g^ value we have got different values of the ^ 

different sizes. Then for every gQ we determine a i^igo)- The mean value of 
these gives the correct exponent u. 
For our two models we have found: 

1/ = 3.8 ± 0.4 , for a = 0.69 (12) 
u = 4.5 ±0.2 , for (T = 0.75. (13) 

The first result is consistent with |0, which gave u = 4.0 ±0.8, and also with 
the one-loop expansion result 0: un = 3 + 36e = 3.84 (here is e = cr — 2/3 = 
0.69 — 2/3). For a = 0.75, instead, we are really too far from amf for the 
one-loop expansion to give a good approximation {uu = 6). 

To find the critical index rj which gives the anomalous dimension of the 
two point correlation function at the critical temperature, we have used the 
FSS properties of the observable Xsg, the so-called spin-glass susceptibility, 
defined as 



ik 

whose scaling behaviour is 

Xsg = N'-'X (nHt - n)) ■ (15) 
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We have got: 

r/ = 1.62 ±0.08 , for (7 = 0.69 (16) 
r] = 1.4 ±0.1 , for a = 0.75. (17) 

The theoretical value of 77 in a long-range system , or, more exactly, its de- 
pendence on cr, such as that described by the Hamiltonian (^, does not vary 
from the mean-field value going in a region of diverging thermodynamical 
fluctuations, because the two-point vertex function (F*^^)) does not have any 
infrared divergence at the critical point. The behaviour of the vertex func- 
tion of the two fields Q°'^ and Q*^"^, as derived from the Hamiltonian (p, is: 



{k) 



k 



1 



jpabcd — 



pabcd _ 



(18) 



where, in our case, = 1, n is the number of the replicas and the tensor 
pabcd defined like in 11131: 



jabcd 



^ac^bd ^ ^aa^bc _ p 



ad xbc 



-^abcd 



and 



T 



abed 



1, 

0, 



if a = 6 = c 
otherwise 



d 



(19) 
(20) 



The integral can be easily computed: 

d'^p 1 



h{k) ^ J 



(27r)^p2a-d (^p^l^ya- 



{k^ 



-2a r 2a 



¥ 



(47r)l r(2rf-2a) 



T{d-a) 



(21) 



Expressing the perturbative expansion in the variable e = a — we see 
that the function Ia{K) has no pole in e. Thus the term k'^"~'^ in T'^'^\k) of 
the free theory needs no correction from any perturbative contribution and 
the anomalous dimension t] of the two-points correlation function does not 
depend on the order of the perturbation expansion. 
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Figure 2: Scaling property of Binder parameter {left) and of spin-glass sus- 
ceptibility (right). g{T) and XsgN~'^^^ vs. N~(T — Tc) are plotted for 
all the sizes of the system with a = 0.75 (Tc = 0.63, z/ = 4.5, r] = 1.4, 
N = 64,128,256,512). 



Therefore, it always has the same dependence on the exponent a: at any 
order isri = d + 2 — 2cx = 3 — 2a. So the theoretical values are: 

r]t = 1.62 , for a = 0.69 (22) 
rit = 1.5 , for or = 0.75 (23) 

and our results are in total agreement with them. Using the so obtained 
values of the critical indices we can plot the scahng behaviour of g and of Xsg 
as shown in figure ^ 

P{q) Analysis and Ultrametricity 

The overlap probability distribution P{q) is one of the most powerful means 
at our disposal to get information about the pure states structure of a spin- 
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glass in its low temperature phase. The P{q), in the standard replica ap- 
proach, is connected to the structure of the finite-volume equilibrium states. 
This point of view has been sometimes criticized, e.g. from Newman and 



Stein ||T5[, but some of the objections raised by them have been overcome 
by showing that the behaviour of the probability distribution functions built 
from window overlaps Q is identical to that of the functions P{q) defined in 
the usual way 

Here we present the data of the numerical simulations using the standard 
replica approach. However the data themselves do not depend on the defini- 
tion of pure state: they are some kind of "experimental" facts that must be 
explained by the theory. 

An analysis of the behaviour of P{q) allow us to discern between the RSB 
frame and the trivial one, in which only two different pure states are allowed. 

Observing the behaviours of the probability distributions shown in figure 
^ we realize that we are studying models, whose low temperature phase 
is described by many equilibrium states, including those states which are 
completely different and that corresponds to the region around g ~ 0. The 
peak becomes higher as grows, while the area under the P^lq), between 
g = and the value of q corresponding to the peak of the distribution, tends 
to remain constant. Furthermore P{\q\ = 0) does not decrease, increasing 
the size of the system but settles down to a non zero value. This is the 
same picture we have in the mean-field case, also if we are now considering 
systems which cannot be treated in the mean-field approximation. The fact 
that these distributions do not end with a 6 function like the theoretical one 
in RSB theory, but are non zero in the whole interval [0, 1], is an expected 
effect of the finite size of the simulated systems. 

The most relevant and particular property of the phase space at finite 
volume that seems to emerge from our analysis is the ultrametricity, the 
special hierarchical structure of spin-glasses equilibrium configurations: we 
can gather hints of the existence of this property using some cumulants built 
from the overlaps qu, qn and g23 of three different, independent replicas. 



^The overlap over a window of linear size B is defined as 

d B-1 

'?^ = :^EE^^'^({^«})^^'^(i^'})' (24) 

i—l Xi 

where d is the dimension of the lattice, Xi are the coordinates on the lattice and B is 
smaller than L, the linear size of the lattice. 
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Figure 3: P{q) at T = 0.5 for the long-range models with a = 0.69 {left) and 
(7 = 0.75 (right). The sizes plotted are N = 32, 64, 128, 256, 512. Increasing 
the size the distribution flattens toward a value of about 1, in the region 
\q\ ~ 0, and the peak become more and more sharp. 



With this aim we have observed the behaviour of the two cumulants 



S,-,^Ai^L=^ and (25) 



_ ^(g-g-sign(gM))\ 

— m — ^''^ 

where qm is the value of the overlap which has the maximum absolute 
value between the three, q and q' are the values of the other two overlaps 
(g, g' < ^m)- The measures are made in every quenched configuration, at 
every temporal uncorrelated interval, once the simulated system has reached 
equilibrium. Like the Binder parameter g, also these observables have a finite 
size scaling behaviour not depending on the index rj. Their FSS form is, in 
fact, 

Bl,^j{NHT-n)). (27) 
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Figure 4: B'^_^{T) for the two long-range systems: a = 0.69 {left), for sizes 
= 32, 64, 128, 256, 512, and a = 0.75 (nght), for sizes = 64, 128, 256, 512. 



Analyzing their behaviours in the proper way we can get different checks of 
the existence of a complicated space of states organized in an ultrametric 
structure. 

If an ultrametric structure exist the cumulants -Bg-q and B'^-q should go 
to zero under Tc in the thermodynamical limit. The two minor overlaps, in 
fact, should become equal and their difference should tend to zero. This is, 
really, the behaviour that we noticed and that is plotted in figures ^ and 
^ the quantities Bq_q and the Bg_^ of a given system tend to zero with 
decreasing temperature and they do that the faster the bigger is the size of 
the system. 

At fixed temperature below the critical one, T = 0.5, we have fitted 
Bq-q{N) with the power-law behaviour A N~''. In both the long-range mod- 
els considered, -Bg-g, at T = 0.5, appear to decrease to zero with this law. 
The exponents are C = 0.091 ± 0.009, for a = 0.69, and C = 0.09 ± 0.01 
for a = 0.75. Because of these small values of (, we would need data about 
systems of greater size to guarantee that Bq^q goes to zero below the criti- 
cal point. Nevertheless the power-law decaying of the Bq^q towards zero is 
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Figure 5: Bq_q vs. temperature for the a = 0.69 model and the a = 0.75 
model {right). The sizes are the same as above. 



consistent with our data. 

Following the behaviour from the high temperature phase the curves cross 
each other in the critical region (we know it from the FSS behaviour) and 
then tend to zero for T — >■ 0. Actually, from this crossing we can have another 
guess of the critical temperature, just like from the Binder parameter g (see 
figure . 

In this case, however, there is no fit of the FSS behaviour (|^) satisfying 
the test. Thus we simply give the average of the last points of intersection 
between the Bg_g(T) curves. The values found are: 

= 0.65 ± 0.08 , for (T = 0.69, (28) 
Tc = 0.60 ±0.06 ,for (J = 0.75. 

Anyway, this estimate agree, within the errors, with the previous one given 
in (plQl). The errors appear to be smaller than in (|10[), but we underline that 
we couldn't manage to do the FSS's fit, neglecting, in this way, the shift of 
the Tc{N) towards the of the system in the thermodynamical limit: the 
values above experience a systematic error. 



12 




As we can note from the figures § and ^ the cumulant is always 

greater then Bg_g. This is due to the fact that not always g'sign(gM) has 
the same sign of q: there are triples of spin configurations giving products 
Q^'qai < 0, that is sign(g'sign(gM)) 7^ sign(g). This imphes that sometimes 
the contributions (g — g'sign(gM))^ to the mean value are bigger than the 
corresponding terms (|g| — \q'\)'^ in Bg^g. The qualitative behaviour of tem- 
perature dependence, however, is not influenced in a critical way from this 
differences and Bg_g(T) goes to zero while T — > just like Bq^g(T). Fitting, 
as before, B'^_^ at the fixed temperature T = 0.5 with the power-law A'iV~^', 
we observe a behaviour statistically consistent with the decaying to zero. 
The exponents are now C' = 0.12 ± 0.01 for a = 0.69 and C' = 0.13 ± 0.02 for 
a = 0.75. 



Conclusions 

In summary, the insight we get about the one-dimensional long-range {J{r) ~ 
spin-glasses is that the critical behaviour satisfy the one- loop predictions 
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for a not too far from 0"^/ = |, but that the first-order e-expansion fail to 
describe it already for a = 0.75. In both examined systems we have been 
able to determine a low temperature phase, showing a non trivial hierarchical 
structure of the space of the finite-volume equilibrium configurations. We 
have built the P{q) distribution, from which we can argue the validity of 
the RSB Ansatz also for cr > |, out of mean-field theory, and we have 
analyzed the ultrametric structure of the equilibrium configurations with the 
cumulants -Bg-g and B'^_^. 

To describe the behaviour of the one- dimensional long-range system with 
interactions decaying like 1/r (a = 1) a few analytical works have been 
made until now [|17 , based on the replica symmetric Ansatz. Our re- 



sults, however, show the inconsistency of this Ansatz in the explored region 
of parameters (i. e. until a = 0.75). The Ansatz of replica symmetry is, fur- 
thermore, violated also in a related model for diluted infinite-range systems 
Consequently further investigation should be done to understand the 



behaviour of such power-law decaying systems for a = 1. 
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